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Abstract — We analyze a class of distributed quantized consen- 
sus algorithms for arbitrary networks. In the initial setting, each 
node in the network has an integer value. Nodes exchange their 
current estimate of the mean value in the network, and then 
update their estimation by communicating with their neighbors 
in a limited capacity channel in an asynchronous clock setting. 
Eventually, all nodes reach consensus with quantized precision. 
We start the analysis with a special case of a distributed binary 
voting algorithm, then proceed to the expected convergence 
time for the general quantized consensus algorithm proposed 
by Kashyap et al. We use the theory of electric networks, 
random walks, and couplings of Markov chains to derive an 
0(N 3 log N) upper bound for the expected convergence time on 
an arbitrary graph of size N, improving on the state of art bound 
of 0(iV 4 logiV) for binary consensus and 0(N 5 ) for quantized 
consensus algorithms. Our result is not dependent on graph 
topology. Simulations on special graphs such as star networks, 
line graphs, lollipop graphs, and Erdos-Renyi random graphs 
are performed to validate the analysis. 

This work has applications to load balancing, coordination of 
autonomous agents, estimation and detection, decision-making 
networks, peer-to-peer systems, etc. 

Index Terms — Distributed quantized consensus, gossip, conver- 
gence time 

I. Introduction 

Over the past decade, the problem of quantized consensus 
has received significant attention 1 1 1|2 1| 3 1|4|[5 1. It models 
averaging in a network with a limited capacity channel (4). 
Distributed algorithms are attractive due to their flexibility, 
simple deployment and the lack of central control. This prob- 
lem is of interest in the context of coordination of autonomous 
agents, estimation, distributed data fusion on sensor networks, 
peer-to-peer systems, etc. [1][6|. It is especially relevant to 
remote and extreme environments where communication and 
computation are limited, for example, in a decision-making 
sensor network (7). 

This work is motivated by a class of quantized consensus 
algorithms in [3 ] and in [4]: nodes randomly and asyn- 
chronously update local estimate and exchange information. 
In 0, the author proposed a binary voting algorithm, where 
all the nodes in the network vote "yes" or "no". The algorithm 
reaches consensus on the initial majority opinion almost 
surely. However, the authors did not bound the convergence 
time. In (8), the authors studied the convergence speed in 
the special case of regular graphs for a similar distributed 
binary consensus algorithm. Draief and Vojnovic [ 6 ] derived 



an expected convergence time bound depending on the second 
largest eigenvalue of a doubly stochastic matrix characterizing 
the algorithm and voting margin, yet no specific bound is 
provided for an arbitrary graph. An 0(N 4 logN) bound is 
given in on the binary voting convergence speed, where N 
is the number of nodes in the network. A more general dis- 
tributed quantized integer averaging algorithm was proposed 
in (4). Unlike the distributed algorithm in fTOlL where the 
sum of values in the network is not preserved, Kashyap et al. 
proposed an algorithm guaranteeing convergence with limited 
communication, more specifically, only involving quantization 
levels. This is a desired property in a large-scale network 
where memory is limited, communication between nodes is 
expensive and no central control is available to the network. 
Also, this distributed algorithm is designed in a privacy- 
preserving manner: during the process, the local estimation 
on the average value is exchanged without revealing the initial 
observation from nodes. Analysis of convergence time on the 
complete graph and line graph is given in the original paper 
in (4), and an 0(N 5 ) bound was derived in Q by creating a 
random walk model. 

In this paper, we start with an analysis of convergence 
time of the distributed binary voting problem. We construct a 
biased lazy random walk model for this random process. We 
improve the upper bound on the expected convergence time 
in from 0(N 4 \ogN) to 0(N 3 \ogN). We then extend 
our results to the multi-level quantized consensus problem 
with the use of Lyapunov functions EKH. By utilizing the 
well-known relation between commuting time of a random 
walk and electric networks ifTTTl . we derive an upper bound 
on the hitting time of a biased random walk. Several coupled 
Markov processes are then constructed to help the analysis. 
We improve the state of art bound in (21 from 0(N 5 ) to 
0(N 3 log AT). 

The contribution of this paper is as follows: 

• A polynomial upper bound of 0(N 3 log N) for the quan- 
tized consensus algorithm. It is, to the best knowledge 
of the authors, the tightest bound in literature for the 
quantized consensus algorithm proposed in [3]|4|. We 
use the degree of nodes on the shortest path on the graph 
to improve the bound on the hitting time of the biased 
random walk. 

• The analysis for arbitrary graphs is extended to a tighter 
bound for certain network topologies by computing the 
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effective resistance between a pair of nodes on the graph. 
This is attractive because we can then apply results from 
algebraic graph theory 1 121 fT3l to compute the effective 
resistance easily on the given graph structure. 

The remainder of this paper is organized as follows. Section 2 
describes the algorithm proposed in [ 3 ] and |4], and formulates 
the convergence speed problem. In Section 3, we derive our 
polynomial bound for this class of algorithms. In Section 4, we 
give examples on how to derive an upper bound on the given 
topology of the network, and simulation results are provided 
to justify the analysis. We provide our conclusions in Section 
5. 

II. Problem Statement 

A network is represented by a connected graph Q = (V, £ ), 
where V = {1, 2, N} is the set of nodes and £ is the set 
of edges, (i, j) G £ if nodes z, j can communicate with each 
other. Mi is the set of neighbors of node i. 

Consider a network of N nodes, labeled 1 through N. 
As proposed in [1][4][3], each node has a clock which ticks 
according to a rate 1 exponential distribution. By the superpo- 
sition property for the exponential distribution, this set up is 
equivalent to a single global clock with a rate N exponential 
distribution ticking at times {Zk}k>o- The communication and 
update of states only occur at {Zk}k>Q- When the clock of 
node i ticks, i randomly chooses a neighbor j from the set 
Mi. We say edge (i, j) is activated. 

In the rest of this section, we will describe the distributed 
binary voting consensus algorithm [ 3 ] and quantized consensus 
algorithm [4|. We are interested in the performance of this 
class of algorithms on arbitrary graphs. 

A. Binary Voting Consensus 

Initially, each node on the connected graph Q has a vote, 
strong positive or strong negative (or no vote at all). Assuming 
that a majority opinion exists, the objective for the binary 
voting consensus problem is to have each node settle on the 
majority in a distributed manner. 

Let S^(t) denote the state of node i at time t. 5 w (t) G 
S~ , W + , W~}, representing strong positive, strong neg- 
ative, weak positive, and weak negative respectively, where 
S ± = ±2 and W ± = ±1. For all i G V, 5^(0) is initialized 
to the corresponding strong positive or strong negative. If i 
does not have a vote at t = 0, it is randomly initialized to 
either weak opinion. When two nodes i and j with opposite 
strong opinions exchange information, they both update to 
weak opinions. Further update rules are as follows: 

1) If =sW(t), 
S&(t+i) = S r W>(t + l) = 

2) If |S« (t)\ > \SW(t)\ and S«(t) • S^(t) < 0, 
SW(t + l) = -S^(t), SW(t+l) = S«(t), and vice 
versa; 

3) If \SW(t)\ > \S&(t)\ and S^(t) • S&(t) > 0, 
S&(t + 1) = (*), SV\t + 1) = S^(t), and vice 
versa; 
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Fig. 1: Update rules for distributed binary vote \3 \. The figure 
shows update principles: when opposite u strong opinion" s 
meet, they both turn into (i weak opinion" s; "strong opinion" 
affects "weak opinion"; and swap principle. 

4) If S«(t) = -SW(t), 

S r W(t + l) = sign {SV)(t)), 
5^ (t + l) = sign 
The update rules are illustrated in Fig. [I] Let 1 5+ 1 denote 
the number of the strong positive opinions and denote 
the number of the strong positive opinions at time t. Note that 
this algorithm supposes that there is an odd number of nodes 
in the network, in order to guarantee convergence regardless 
of initial votes of nodes. 

Definition 1 (Convergence on Binary Voting Consensus). A 

binary voting reaches convergence if all states of nodes on the 
graph are positive or all states are negative. 

A quick validation for this algorithm: we notice that the 
aS + and S~ will only annihilate each other when they meet, 
otherwise they just take random walks on the graph. So only 
the majority strong opinions will be left on the graph in the 
end. That is the reason why randomly assigning weak opinions 
to nodes with no initial vote does not affect the convergence 
to the majority opinion. We also notice that strong opinions 
can influence weak opinions as shown in Fig. [T] Eventually 
all agents will take the sign of the majority strong opinions. 
Because the graph has finite size, and this Markov chain has 
finite states, convergence will happen in finite time almost 
surely. 

B. Quantized Consensus 

Without loss of generality, let us assume that all nodes hold 
integer values and the quantization is 1. Let Q^\t) denote the 
integer value of node i at time t, with QW(0) denoting the 
initial values. Define 

N 

Qsum = ^g (O (0). (1) 

i=l 

Let Qsum be written as qN + r, where < r < N. Then 
the mean of the initial value in the network jfQ sum £ [q,q + 
1). Thus either q or q + 1 is an acceptable integer value for 
quantized average consensus (if the quantization level is 1). 

Definition 2 (Convergence on Quantized Consensus). A quan- 
tized consensus reaches convergence at time t, if for any node 
i on the graph, Q^\t) G {<?, q + 1}. 
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There are a few properties that are desired for the quantized 
consensus algorithm: 

• Sum conservation: 

N N 

Y / Q {i) (t) = Y / Q (i) (t + i). (2) 

i=l i=l 

• Variation non-increasing: if two nodes i, j exchange 
information, 

|Q«(t + 1) - Q {j) (t + 1)| < " Q W) Wl- (3) 

When two nodes z and j exchange information, without loss 
of generality, suppose that Q^\t) < Q^\t). They follow the 
simple update rules below: 

1) If Q^\t) — Q^\t) > 2, a non-trivial exchange occurs: 

Q {i) (t + l) = Q iz) (t) + l, Q U) (t + l) = Q ij) (t)-l. 

2) If Q( j \t) - Q {i) (t) < 1, a trivial exchange occurs: 

Q®(t + 1) = Q W) (*),Q W) (* + 1) = Q^(t). 

Similar to the argument in Section |II-A| we can view this 
random process as a finite state Markov chain. Because the 
variation decreases whenever there is a non-trivial exchange, 
convergence will be reached in finite time almost surely. 

Remark 1: In this quantized consensus algorithm, we define 
convergence to be when all nodes reach two consecutive states. 
However, This definition cannot be used to solve the binary 
voting problem. If all nodes converge to W + and W~ states, 
no conclusion can be made on the majority opinion. 

Remark 2: In this section, the update rules allow the node 
values to change by at most 1. This is relevant to load- 
balancing systems where only one value can be exchanged 
in the channel at a time due to the communication limit (4]|. 
Adjustments can be made for this class of quantized consensus 
algorithms, e.g. when two nodes exchange information, both 
nodes can update their value to the mean of the two. The 
analysis on the convergence time remains similar. 

III. Convergence Time Analysis 
The main results of this work are the following theorems: 

Theorem 1. For a connected network of N nodes, an upper 
bound for the expected convergence time of the binary voting 
consensus algorithm is G(N 3 \og(N)). 

Theorem 2. For a connected network of N nodes, an upper 
bound for the expected convergence time of the quantized 
consensus algorithm is Q(N ?> \og(N)). 

We use the analogy of electric networks and random walks 
to derive the upper bound. Since the clock setting and edge 
selection strategies are the same in the binary voting algo- 
rithm and quantized consensus algorithm, their information 
exchange processes can be coupled. Hence the meeting time 
(defined below) is equal in both algorithms. Before deriving 
the bound on the convergence time, we first provide some 
definitions and notation that we will use and prove some useful 
lemmas in Section Ifll-AI and Section Ifll-BI 



A. Definition and Notation 

Definition 3 (Hitting Time). For a graph Q and a specific 
random walk, let denote the expected number of steps 

a random walk beginning at i must take before reaching j. 
Define the "hitting time" of Q by H(G) = max^- 7~L(i,j). 

Definition 4 (Meeting Time). Consider two random walkers 
placed on Q. At each tick of the clock, they move according 
to some joint probability distribution. Let M(i,j) denote the 
expected time for the two walkers to meet at the same node 
or to cross each other through the same edge ( if they move at 
the same time). Define the "meeting time" of Q by A4(G) = 
max i;J M(iJ). 

Define a simple random walk on Q, X$, with transition 
matrix P s = (P i:j ) as follows: 
. P£:=0 for Mi G V, 

Mi is the set of neighbors of node i and \M% | is the degree of 
node i. 

Define a natural random walk with transition matrix 
P N = (P i:j ) as follows: 

• i^ = l-^forV*GV, 

• p il = ivjk for e £ - 

Define a biased random walk Xb with transition matrix 
P B = (p^) as follows: 

. Pi : =l-i-£ fceM] ^forVieV, 

B. Hitting Time and Meeting Time on Weighted Graph 

In this class of algorithms, we label the initial observations 
by the nodes as ot2, ajy. Before any two observations 
am , a n meet each other, they take random walks on the graph 
Q. Their marginal transition matrices are both P B . It may be 
tempting to think that they are taking the natural random walks 
as stated in [2]. Upon closer inspection, we find that there are 
two sources stimulating the random walk from i to j, for all 
G S: one is active, from the node i, P}- = P-J; the 
other one is passive, from its neighbor j, Pf- = Pjf . Thus 
Pij = P}j + Pfj\ i.e., the transitional matrix is actually P B 
instead of P N . Denote this random process as X. Because of 
the system settings, two random walks a m: a n can only move 
at the same time if they are adjacent. Suppose a m is at node 
x, and a n is at node y. 

For x £ J\f y , and i G M x , we have 

Px}omt(®m moves from x to z, a n does not move) 

= P B — Pxjomt(&m moves from x to i, a n moves) 

= P%. (4) 

Similar for PYj i nt (a n moves from y to j, a m does not move). 
Also, 

Px]omi{pt"m does not move, a n does not move) 

= i-E^-E^- (5) 

ieAf x j£N y 
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For x G M y and i ^ y we have, 

Pxiomt(®m moves from x to ?, a n does not move) 
= P xi — PAfjoint(^m moves from x to i, a n moves) 
= P*- (6) 



^at joint (<^m moves to ?/, a n moves to x) = P 3 



xy 



(7) 



P;tj j nt (a m does not move, a n does not move) 



i - y p b - v p b + p b . 



(8) 



Corollary 1. TTie biased random walk Xp is a reversible 
Markov process. 

Proof: Let tt be the stationary distribution of Xb- It is 
easy to verify that 

** = w (9) 

for all i eV. Thus by the symmetry of P B , 

-.1'!; = -j I'll 



Lemma 1. In an arbitrary connected graph Q with TV nodes, 
the hitting time of the biased random walk Xb satisfies 

H P B(g) < 37V 3 . 

Proof: The biased random walk Xb defined above is a 
random walk on a weighted graph with weight 



1 / 1 1 

^ : ~ n \m + m 



Wn := TT I 7TTT + 7TTTT I for (/'. j) G E. (10) 



(ID 



wi — ^ u^- = 1, w = ^ = iV. (12) 

It is well-known that there is an analogy between a weighted 
graph and an electric network, where a wire linking i and j 
has conductance Wij, i.e., resistance = 1/wij (HIE). 
And they have the following relationship 



U p b (x, y) + H p b (2/, x) = wr' xy , 



(13) 



where r' is the effective resistance in the electric network 



xy 



between node x and node y. Since the degree of any node is 
at most N — 1, for (i,j) G £, 

1 1 



> 



N\\Mi\ \Mj\ 
1 1 



iVmin(|M|,|A/}|) 

nj <N xmin(\Mi\,\Mj\) (14) 
Consequently, ■ < < N x min(|A/i|, |A/}|). 



For all xjGV, let Q = ( Ql = x,q 2 ,q$, ...,qi-\,qi = y) 
be the shortest path on the graph connecting x and y . Now 
we claim that 



i 

fc=l 



Since any node, say u not lying on the shortest path can 
only be adjacent to at most three vertices on Q (otherwise u 
must be on the shortest path), we have 



i 

E 

k-i 



\M qk \ < 2Z + 3(iV-Z) < 37V. 



By (14) and (15), we have 



^<iVx^|^|<3iV 2 



(15) 



(16) 



By ( 13 ), we have 

H P B(x,y) 



< 



< 



k=l 

U P B{x,y) +H P B(y,x) 

! 



wr 



xy 



TV x 37V 2 
37V 3 . 



(17) 



This completes the proof. ■ 
Note that this is an upper bound for arbitrary connected 
graphs. A tighter bound can be derived for certain network 
topologies. Examples will be given in Section [TV] 

Corollary 2. %p B (x,y) + T-L P B(y,z) + H p b(z,x) = 
H p b(x,z) + H P B(z,y) + H P B(y,x). 

Proof: This is direct result from Lemma 2 in Chap 3 of 
Aldous-Fill's book ifTTTl since X p is reversible. ■ 

Definition 5 (Hidden Vertex). A vertex t in a graph is said 
to be hidden if for every other point in the graph, H(t,v) < 
l~L{v,t). A hidden vertex is shown to exist for all reversible 
Markov chains in 4731/ . 

Lemma 2. The meeting time of any two states on the network 



Q following the random processes X in Section III-B is less 
than 4HpB (Q). 

Proof: In order to prove the lemma, we construct a 
coupling Markov chain, X' to assist the analysis. X' has the 
same joint distribution as X except ^ and ([8]). 



Px>joint(arn, ci n meet at x or y) = 2P X 



(18) 



Px 'joint (a m does not move, a n does not move) 



First, we show that the meeting time of two random walkers 
following X' is less than 2H p b{Q). 

For convenience, we adopt the following notation: if /(•) is 
a real valued function on the vertex of the graph, then f(y) 
is the weighted average of f(u) over all neighbors u of v, 
weighted according to the edge weights. 
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Similar as in l2l|[T5lL define a potential function 

<j>(x, y) := U p b (x, y) + U p b (y, t) - U p b (t, y), (20) 

where t is a hidden vertex on the graph. By Corollary [2] 
(j)(x,y) is symmetric, i.e. (j){x,y) = <p(y : x). By the definition 
of meeting time, M is also symmetric, i.e. M(x,y) = 
M.{y,x). Next we use <j) to bound the meeting time. 
By the definition of hitting time, for x ^ y we have 

H pB (x,y) 

= i + p^n P B ( x , y)+J2 p ^ n ? B (*> y) 

ieJV x 

= l + w xx 'HpB(x,y)+ ^2 w xi n P B(i,y), (21) 

i£Af x 



i.e., 



Up B (x,y) = 



T,ieAf x w ^ n P B (^y) 



^ieJV x w xi ^2ieJV x w xi 

=— ^ +H(x,y). (22) 

2^ieM x w xi 



So for x 7^ y, 



(/>(x,y) 



■(/>(x,y). 



(23) 



M x >(x,y) = 1+ 1- P *- E P vj ) M x >(x,y) 

+ E PyjM X >{x,j). 



(24) 



Note that J24l also holds for x G Af v . We now have 



= 1+E P®M x ,(i,y) + £ P*A^(z, j).(25) 
25] ) shows that at least one of the two inequalities below holds: 

M x > 0, y) > ^ ^ = M x > 0, y) (26) 



A^Af (a;,2/) > 



V P B 

T,jeM y p ?jMx'{x,j) 



Mx>(x,y) (27) 



V P B 

^jeNy yj 

Without loss of generality, suppose that ( [27] ) holds (otherwise, 
we can prove the other way around). From ([25]), we have 



J2 P*M x ,{x,y) = 1+J2 p *M X >(i,y) 

ieAf x ieAf x 

J2 P y B jMx>(xJ) - J2 PyjMx>(x,y). (28) 

jeAfy jeAfy 



i.e., 



Mx>{x,y) 



V P 1 

ieAfx 



+ Mx*(x,y) 



P%(M x >(x,y)-M x >(x,y)) 

jeMy 



< 



w * 



V p b 

i£Af x 

+ Mx>(x,y). 



(29) 



Now we claim that Mx' (x, y) < <j>(x, y). Suppose it is not the 
case. Let /? = m&K x ^ y {Mx' {x, y) — ^(x^y)}- Among all the 
pairs y realizing /?, choose any pair. It is clear that x ^ y, 
since Mx*(x,x) = < <j>(x,x). By ([23]) and ([29]), 



M X '{x,y) 



<t>(x,y) + /3 
1 



eAf x w xi 
1 

> M X '{x,y). 



> 



(x,y) +/3 
+ Mx>{x,y) 



(30) 



This is a contradiction. Thus Mx'(G) < <t>{%, y) < 2H p b (Q). 

Now we are ready to complete the proof of Lemma [2] We 
couple the Markov chains X and X' so that they are equal 
until the two random walkers become neighbors. Note that 
half of the time when the walkers in X ' meet, they do not 
meet in X , but stay in the same position. We claim that 

Mx(G) <2M X '(G). 

In the random process X' ', when two random walkers m, n 
meet, instead of finishing the process, we let them cross and 
continue the random walks according to Px 'joint- The expected 
length of each cross is less than or equal to M x f (g)- At each 
cross, the random process X finishes with a probability of 1/2, 
independently. Thus for any x, y £ V we have 

OO , v i 

Mx(x : y)<J2[o) iMx'(Q) = 2Mx'{G)- (31) 
i=i ^ ' 

This completes the proof. ■ 
Now we are ready to prove Theorems 1 and 2 in the next 
two subsections. 

C. An Upper Bound on Binary Consensus 

Without loss of generality, let us suppose that in the initial 
setting more nodes hold strong positive opinions (5 + ). As 



briefly analyzed in Section |II-A[ the process undergoes two 
stages: the depletion of and the depletion of W~ . By our 
assumption, 

|S + (0)| > |S"(0)| (32) 



and 

\S + (0)\ + \S-(0)\=N, 
where N is the number of nodes on the graph. 



(33) 
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According to the update rules in Section |II-A| we have 

\S + (t)\-\S-(t)\ = \S + (0)\-\S-(0)\. (34) 

Let Ti and T2 denote the maximum expected time it takes 
for Stage 1 and Stage 2 to finish. In the first stage, two opposite 
strong opinions annihilate when an edge between them is 
activated. Otherwise they take biased random walks on the 
graph Q. In the second stage, the remaining |6' + (0)| — |5~(0)| 
strong positives take random walks over graph Q, transforming 
weak negative into weak positive. 

Let CTg(v) denote the expected time for a random walker 
starting from node v to meet all other random walkers who 
are also taking random walks on the same graph but starting 
from different nodes. Define 

CT(Q) = maxCTgO). 

Corollary 3. Let MxiG) be the meeting time of the biased 
random walk X defined in Section \II-A\ Then 



CT(G) = 0(M x (G) log TV). 



(35) 



Proof: Since there are no more than N consecutive 
meetings, we can easily get a union bound for CT{Q), which 
is NMx(G). 

In order to obtain a tighter bound for CT(Q), we divide 
the random walk into In N periods of length kMx(G) each, 
where k is a constant. Let a be the "special" random walker 
trying to meet all other random walkers. For any period i and 
any other random walker v, by the Markov inequality, we have 



< 



so 



Pr(a does not meet v during period i) 

Mx(G) 

kMx(G) 
1 

k 



Pi (a does not meet v during any period) 

x In N 

< I-] =N~ lnk 



(36) 



(37) 



If we take the union bound, 



Ft (a doesn't meet some walker during any period) 

(38) 



< N -N- 



-lnfc 



Conditioning on whether or not the walker a has met all 
other walkers after all kMx{G) In N steps, and using the 
previous NMx(G) upper bound, we have 

CT(G) < kMxiG) IniV + iV • N~ lnk • NMxiG) 

= kMx(G)\nN + N 2 - lnk Mx(G) (39) 

When k is sufficiently large, say k > e 6 , the second term 
is small, so 



This completes the proof. ■ 
Proof of Theorem 1: In order to analyze Stage 1, we 
can construct a coupling process. When two different strong 
opinions meet, instead of following the rules to change into 
weak opinions, they just keep their states and keep moving 
along the same path they would have as weak opinions. This 
process is over when every strong opinion has met all other 
opposite strong opinions, by when Stage 1 must have finished, 
i.e. before at most N 2 /A such meetings. The rest of the proof 
just follows from Corollary [3] except we divide the random 
walks into m(A/" 2 /4) periods of length kMx(G) instead of 
InN. Hence we have T x < 2CT(Q). T 2 < CT(G) follows 
from the fact that there are at most N — 1 meetings for a 
single strong opinion to meet all the weak opinions to ensure 
convergence. By Lemma [T], Lemma [2] and Corollary [3] , both 
Ti and T 2 are 0(A^ 3 logA^). 

Hence the upper bound of convergence time of binary voting 
is thus O(Af 3 logA0. ■ 

D. An Upper Bound on Quantized Consensus 

Recall that a non-trivial exchange in quantized consensus 
happens when the difference in values at the nodes is greater 
than 1. 

Let Q(t) denote a vector of values all nodes holding at time 
t. Set Q = Qsum/^V", where Q S um is defined in {]]). 
We construct a Lyapunov function Lq l2l l4l iflQl as: 



L Q (Q(t)) 



N 

E 



{Qi(t)-QY 



(41) 



Let m = min i Qi(0) and M = max^Q^O). It is easy to 



see that Lq (Q(0)) < 



(M—m)N 



. Equality holds when half of 



the values are M and others are m. 
Corollary 4. In a non-trivial exchange, 

L Q (Q(t)) >Lq(Q(* + 1)) + 2. 
Proof: A non-trivial exchange follows the first update rule 



of quantized consensus algorithm in Section |II-B| 

Suppose Qi(t) = x\ and Qj(t) = £2 have a non-trivial 
exchange at time t, and the rest of the values stay unchanged. 
Without loss of generality, let x\ < X2 — 2. We have 



Lg(Q(f))-Lg(Q(f+l)) 

x \ + x 2 - ( x l + I) 2 _ ( x 2 - 

2(x 2 -x ± ) -2 > 2. 



1) 



(42) 



CT(G) < (k + l)M x (G)kiN. 



(40) 



Proof of Theorem 2: Corollary [4] shows that the Lya- 
punov function is decreasing. The convergence of quantized 
consensus must be reached after at most 7 = ( M ~^-) N non _ 
trivial exchanges. Similar to the analysis for the binary voting 
algorithm, when every random walker has met each of the 
other random walkers 7 times, all the non-trivial exchanges 
must have finished. By Corollary [3] this process finishes in 
0(N 3 log N) time. ■ 
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Fig. 2: A star network. 



IV. Simulation Results 



In this section, we give examples of star networks, line 
graphs and lollipop graphs in order to show how to use the 



analysis in Section III for the particular graphs with known 
topologies. Simulation results are provided to validate the 
analysis. We also simulate the distributed process on Erdos- 
Renyi random graph in order to get some insight on how the 
algorithm performs on a random graph. 

A. Star Networks 

Star networks are a common network topology. A star 
network S of N nodes has one central hub and N — 1 leaf 
nodes, as shown in Fig. [2] Now let us derive an upper bound 



following the similar analysis in Section III 



1) Analysis: By ( [T0| ) in Section [III-B| suppose that there is 
a star network of TV nodes, with the central hub denoted as c. 

For Vi, j ^ c, we have 

N \ ^ N -1 J N -1' 



(43) 



The equivalent resistance between any two leaf nodes i and j 
is 



= 2iV - 2. 



w 



(44) 



JC 



By the symmetry of the star network, it is easy to see that 



By {T3), 



H p b(iJ) = H P B(j,i). 



H P B(S)=H P B(i,j)=N(N-i). 



(45) 



Then following similar analysis in Section |III-C| and Section 



III-D we can bound the convergence time of both binary and 
multi-level quantized consensus algorithms of a star network 
by 0(N 2 log TV). 

2) Simulations: We simulate the star networks with the 
number of nodes N ranging from 21 to 481 , with intervals of 
20, for both binary consensus and quantized consensus algo- 
rithms. For binary consensus, Initially, there are \N/2] strong 
positive and [N/2\ strong negative nodes, i.e., |S + | — IS' - ! = 
1. Those nodes communicate with each other following the 



protocol in Section II-A The process finishes when consensus 
is reached. Simulation results on binary consensus are shown 
in Fig. 5a and are indeed of order 0(N 2 logiV), as analyzed 
above. 



3 



4 



Fig. 3: A line graph. 



For quantized consensus, we show two different initial 
settings: (1) QW(0) = 2, QW(0) = 0, QM(0) = 1, for 
k ^ i,j and z, j ^ c, Fig. Bb} (2) Initial values of nodes are 



drawn uniformly from 1 to 100, Fig. 5c Nodes on the graph 
exchange information according to the update rules in Section 

una 

We notice that quantized consensus algorithm converges 
faster than the binary consensus in the above setting, because 
a non-trivial exchange takes place whenever the difference of 
the values between the selected nodes is greater than one. 
The Lyapunov value is non-increasing. However, in binary 
consensus, a strong negative opinion can influence the weak 
opinions before its annihilation. In the first setting in quantized 
consensus simulation, there is only one non-trivial exchange 
before reaching convergence, hence the convergence time is 
actually the meeting time of the graph. In the second setting, 
due to the uniform distribution of node values, the non-trivial 
exchange is more often than the first setting, because the 
special structure of a star network, central hub can balance 
the values of leaf nodes quickly. 

Convergence time in all cases is the average of 20 rounds 
of simulations. 

B. Line Graph 

A line graph is a simple graph structure. Nodes in a line 
graph C are connected to one another in a line as shown in 
Fig. [3] Although a line graph is less realistic in applications, it 
serves as an example here to show that the convergence time 
can indeed reach 0(N 3 logiV), thus to show the tightness of 
the derived bound. 

1) Analysis: In a line graph of N nodes, for two adjacent 
nodes z, j (not end points), we have 



N V 2 



N 



(46) The equivalent resistance is 



N. 



(48) 



For two end points, similarly, both have resistance of 2/3N 
with their neighbors. Thus the effective resistance between 
two end points m, n of the line graph is N 2 — |iV. By the 
symmetry of a line graph, the hitting time of the graph is 



1 



U p b (C) = U p b (m, n) = -N N' 



-N 



(49) 



The rest follows the analysis in Section [IV-Al| an upper bound 
on the convergence time for binary and multi-level quantized 
consensus is 0(N 3 log N). 

2 ) Simulations: Experiment settings for line graph are same 



as in Section IV- A2 The results are plotted in Fig. pq - Fig. 
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Fig. 4: A lollipop graph. 



C. Lollipop Graph 

A lollipop graph is a line graph joined to a clique. Fig. [4] 
shows a lollipop graph V with TV nodes, m of which form a 
clique K m , and the rest of TV — m nodes connected to K m by 
node i as a line. It is well known that a lollipop graph, when 
m = L(27V + l)/3j,is the extremal graph for the maximum 
hitting time 0(N 3 ) of a simple random walk |[T6lll[T7l . In a 
simple random walk starting from i, the walker is very unlikely 
to go to j, compared with from j to i. This results in a latency 
factor of N for a simple random walk starting from the clique 
and going to the end of the line on the lollipop. For a natural 
random walk Xj^ on V, the hitting time is 0(N 4 ) 0, because 
of the laziness of X^f. However, it is not the case in a biased 
random walk. Since P$ = P$, it is equal likely that a random 
walker moves from i to j and from j to i. 

For any two nodes s,t on the clique K m , and m is O(N), 



1 

N 



1 



1 



m 



N(m — 1) ' 



(50) 



The effective resistance of a clique is clearly less than 
r st = l/w st — 0(7V 2 ), and therefore the hitting time from 
any node on K m to i is 0(N 3 ). Furthermore, the line o n V 
has hitting time of 0(7V 3 ), as analyzed in Section 
then have 



IV-B 



We 



U pB (V) = 0(N 3 ). 



(51) 



Similarly, an upper bound of convergence time is 0(N 3 log N) 
for lollipop graph. 

Experiment settings for a lollipop graph are the same as in 



Section IV- A2 The results are plotted in Fig. 5g - Fig. pi 



D. Erdos-Renyi random graph 

In an Erdos-Renyi random graph 1Z, an edge is set between 
each pair of nodes independently with equal probability p. As 
one of the properties of Erdos-Renyi random graphs, when 

P> 

EU 

E (number of edges) = 0.5N(N - l)p. 



(l+e^iog n ^ t j ie g m ph 1Z will almost surely be connected 



The diameter of Erdos-Renyi random graphs is rather sensitive 
to small changes in the graph, but the typical distance between 
two random nodes on the graph is d = ^f^ m EH. 



log(pAT) 

We created Erdos-Renyi random graphs by setting p = 
5 log N/N, where N ranged from 21 to 481, with an interval 



of 20. Other settings are the same as in Section IV- A2 



in Fig. [5j] - Fig [51] It appears that the expected convergence 
time of binary consensus is on the order of N 2 log N, which 
is lower than the general upper bound of Theorem 1 . 

V. CONCLUSIONS 

In this paper, we use the theory of electric networks, random 
walks, and couplings of Markov chains to derive a polynomial 
bound on convergence time with respect to the size of the net- 
work, for a class of distributed quantized consensus algorithms 
OH. We improve the state of art bound of 0(N 4 log N) 
for binary consensus and 0(N 5 ) for quantized consensus 
algorithms to 0(7V 3 log7V). Our analysis can be extended 
to a tighter bound for certain network topologies using the 
effective resistance analogy. Our results provide insights to the 
performance of the binary and multi-level quantized consensus 
algorithms. 
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(a) Simulation results of average convergence time 
on binary consensus algorithm of star networks. 
The solid line indicates 0.637V 2 log TV. 



(b) Simulation results of average convergence time 
on quantized consensus of star networks in setting 
1. The solid line indicates 0.6TV 2 , and the dash 
line indicates 0.7TV 2 . 



(c) Simulation results of average convergence time 
on quantized consensus of star networks in setting 
2. The solid line indicates 137V log TV, and the dash 
line indicates 15TVlogTV. 




(d) Simulation results of average convergence time 
on binary consensus algorithm of line graphs. The 
solid line indicates 0.157V 3 log TV. 




(e) Simulation results of average convergence time 
on quantized consensus of line graphs in setting 1 . 
The solid line indicates 0.177V 3 . 




(f) Simulation results of average convergence time 
on quantized consensus of line graphs in setting 2. 
The solid line indicates 0.257V 3 . 




(g) Simulation results of average convergence time 
on binary consensus algorithm of lollipop graphs. 
The solid line indicates 0.147V 3 log TV. 



(h) Simulation results of average convergence time 
on quantized consensus of lollipop graphs in setting 
1. The solid line indicate 0.157V 3 . 



(i) Simulation results of average convergence time 
on quantized consensus of lollipop graphs in setting 
2. The solid line indicate 0.37V 3 . 




(j) Simulation results of average convergence time 
on binary consensus algorithm of Erdos-Renyi ran- 
dom graphs. The solid line indicates 27V 2 log TV, 
and the dash line indicates 2.3TV 2 log TV. 



(k) Simulation results of average convergence time 
on quantized consensus of Erdos-Renyi random 
graphs in setting 1. The solid line indicates 0.5TV 2 , 
and the dash line indicates 0.7TV 2 . 



(1) Simulation results of average convergence time 
on quantized consensus of Erdos-Renyi random 
graphs in setting 2. The solid line indicates 1.1TV 2 . 



Fig. 5: Simulation results on average convergence time (squares) of binary consensus and quantized consensus versus the size 
of networks. 



